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^ We describe an effective landscape introduced in [1] for the analysis of Constraint Sat- 

isfaction problems, such as Sphere Packing, K-SAT and Graph Coloring. This geometric 
construction reexpresses these problems in the more familiar terms of optimisation in rugged 
^ energy landscapes. In particular, it allows one to understand the puzzling fact that unsophis- 

^ ticated programs are successful well beyond what was considered to be the 'hard' transition. 
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and suggests an algorithm defining a new, higher, easy-hard frontier. 
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Amongst glassy systems, the particular class of 'Constraint Optimisation' has received 
constant attention |2], |3]. These are problems in which we are given a set of constraints that 
must be satisfied, and our task is to optimize the conditions without violating them. The 
typical example is packing: we are asked to put as many objects (spheres, say) in a given 
volume, without violating the constraint that they should not overlap. Another example 
that has been widely studied by computer scientists is K-SAT, where we have Boolean 
variables, and aN logic clauses: our task is to add more and more clauses while still finding 
some set of variables that satisfy them. One last example is the g-coloring problem: we 
have a graph with A^ nodes and aA^ links and our task is to color each vertex with one of 
q colours, with the condition that linked vertices have different colours. If we consider a 
sequence of graphs as a set of nodes and a predefined list of links, then adding links one by 
one makes the problem harder and harder. 

What motivated our interest in these problems was what we percieved as a confusing 
situation in the literature. Consider first sphere packing. In Fig. [T]we show different volume 
fractions that are often quoted in the literature. In particular 'Random Close Packing' (as 
defined empirically), the 'optimal random packing' (zero-temperature glass state) and the so- 
called 'J-point', are sometimes used as synonyms and sometimes not. The 'J-point' deserves 
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FIG. 1: The various transition densities for the sphere-packing problem. 



some explanation. It can be defined as follows P]: one starts from small spheres in random 
positions, and 'infiates' them gradually (in the computer, of course), only displacing them the 



3 



least neccessary to avoid overlaps [6]. At some point the system blocks and the procedure 
stops: this is the J-point. It was studied extensively by the Chicago group [H [5], who 
proposed that it be identified with Random Close Packing. On the other hand, Random 
Close Packing is often associated with the zero-temperature ideal glass state. The two 
identifications seem hardly compatible, as they would imply that the fast algorithm described 
above allows to find rapidly the ideal glass state, contrary to all our prejudices. 

Let us now turn to the SAT and Colouring problems. Carrying over the knowledge 
from mean-field glasses, it was concluded that the set of solutions evolves, as the difficulty 
is increased, in the following manner: for low a the set of solutions is connected. As a 
is increased there is a well defined 'dynamic' or 'clustering' point at which the set of 
satisfied solutions breaks into many comparable disconnected pieces At a larger value 
ax the volume becomes dominated by a few regions, and finally, at some ac, there are no 
more solutions [7j. 

Beyond the clustering transition the problem was thought to become hard. And yet, 
as it turned out, even very simple proarams IT^ manage to find solutions well beyond this 
hard transition! The situation is showed in Fig. [2j This is another puzzle we set out to 
clarify. 

A first observation one can make is that the 'J-point' procedure can be generalised to all 
of these problems: one just has in all cases to increase the difficulty gradually, and keep the 
system satisfied by minimal changes each time. For example, for the Colouring problem, 
one adds one link at a time, and corrects any miscoloring generated by such an addition. 
The number of colour fiips needed each time to correct the miscoloring grows and it diverges 
with a well-defined, reproducible power law (see Fig. [s]) at a value a*, by definition the limit 
reached by the program. 

Second, and most important, we introduce a (pseudo) energy landscape as follows (see 
Fig. |4]). As the difficulty in the problem is increased - by increasing the radius, or adding 
clauses, or adding links - the set of satisfied configurations becomes a subset of the previous 
one. This allows to construct a single- valued envelope function (Fig. |4]): the pseudo-energy. 
It is easy to see that the J-point procedure is just a zero-temperature descent on this landscape. 

We can now carry over everything we know from energy landscapes. For the J-point in 
the context of sphere packings, we conclude that: 
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FIG. 2: Why is it so easy to go beyond ad, the putative 'hard' Umit? Values of the parameter: i) 
ad the 'clustering' transition, ii) a as AT for ASAT, a* for our algorithm, iii) asp the performance 
of a Survey Propagation implementation, and iv) Oc the optimum [8]. 

• The J-point, being the result of a gradient from a random configuration, cannot be 
the optimal amourphous solution. It is just the analogue of the infinite temperature 
inherent structures. 

• It is in general more compact than the clustering (Mode Coupling) point, since it gains 
from 'falling to the bottom of one cluster'. 

• It may be more or less compact than the Kauzmann (a^) point itself, depending on 
the dimension, polydispersity, shape, etc. 

For problems such as SAT and Coloring, we have now a recursive incremental algorithm, 
in which one increases the difficulty at small steps, at the same time correcting the configu- 
ration minimally in order to stay satisfied [12]. This algorithm finds solutions in polynomial 
time up to a a* > ad- Once ad is reached, the current solution remains 'trapped' within one 
cluster. On increasing further a (for example, in the Coloring problem, by adding further 
links), the cluster of solution contracts until it finally dissappears at a*. As one can see in 
Fig. |2| one can go quite a long way beyond ad- How much so depends on how fast the 
cluster dissapears: gradually for small q and K (in Coloring and SAT, respectively), and 
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FIG. 3: Integrated number of colour flips needed to avoid miscolourings, per unit size, for the three 
and four colouring problem. The clustering transition and glass transitions are no obstacle. 
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FIG. 4: Pseudo-energy (conjugated to pressure) landscape for constraint optimisation problems. 
The sets of satisfied configurations at increasing levels of difficulty are included in the previous: 
this allows for the definition of a well-defined envelope. 

essentially immediately for large q, K and for problems that have variables whose value is 
frozen within a cluster. 

Our conjecture is that unsophisticated programs will not do better than a*, or rather, 
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than its 'slow annealing' version as above [12]. Comparison with message-passing algorithms 
such as Belief and Survey Propagation is complicated by the fact that neither our version 
of the Recursive Incremental program, nor the published implementations of Survey Prop- 
agation have been pushed to their optimum [13]. With this caveat, the Survey Propagation 
algorithm seems to do better in the Coloring problem. On the other hand, Braunstein and 
Zecchina have recently shown that a message-passing algorithm does well in the Binary 
Perceptron model [H] - a problem with single-configuration states - and this suggests that 
these algorithms go beyond a* in that case. At any rate, it would be very interesting to 
explore along these lines the K = ?> SAT problem, a much better studied case. 

Perhaps the greatest promise of this approach comes from the fact that, as we have 
indicated in Ref. ^, a* defined by the Recursive Incremental algorithm lends itself, due to 
its simple geometric definition, to an analytic computation. 
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